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1. Introduction 

Portfolio optimization, hedging and derivative pricing are fundamental problems in mathematical 
finance, which are closely related to each other. A basic optimization problem of mathematical finance, 
such as optimal portfolio choice or hedging, is to optimize 

E[U(X^,' 7r )] overall tt from a class II of strategies, (1-1) 

where X^' 71 = x + J Q n u dS u is the wealth process starting from initial capital x, determined by the 
self-financing trading strategy tt and II is some class of admissible strategies. U is an objective function 
which can be depended also on w. It can be interpreted as a utility function or a function which measures 
a hedging error. 

If we assume that U (x) is strictly convex (for each w) then one can interpret U as a function which 
measures a hedging error and consider the problem 

to minimize E[U(X^)] over all tt from II. (1-2) 

In [31] a backward stochastic PDE for value function 

T 

V(t, x) = essinf E(U(x + [ iT u dS u ) / F t ) (1.3) 
wen J 
t 

of (1.2) was derived and in terms of solutions of this equation a characterization of optimal strategies 
was given. We shall use the same approach to the case when the objective function U is strictly concave. 
In particular, if U is a utility function, then (1.1) corresponds to the utility maximization problem 

to maximize E[U(X^' n )} over all tt £ II, (1-4) 

i.e., for a given initial capital x > 0, the goal is to maximize the expected value from the terminal wealth. 
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The utility maximization problem was first studied by Merton (1971) in the classical Black-Scholes 
model. Using the Markov structure of the model he derived the Bellman equation for the value function 
of the problem and produced the closed-form solution of this equation in cases of power, logarithmic and 
exponential utility functions. 

For general complete market models, it was shown by Pliska (1986), Cox and Huang (1989) and 
Karatzas et al (1987) that the optimal portfolio of the utility maximization problem is (up to a constant) 
equal to the density of the martingale measure, which is unique for complete markets. As shown by He 
and Pearson (1991) and Karatzas et al (1991), for incomplete markets described by Ito-processes, this 
method gives a duality characterization of optimal portfolios provided by the set of martingale measures. 
Their idea was to solve the dual problem of finding the suitable optimal martingale measure and then to 
express the solution of the primal problem by convex duality. Extending the domain of the dual problem 
the approach has been generalized to semimartingalc models and under weaker conditions on the utility 
functions by Kramkov and Schachermayer (1999). See also more recent papers [12], [35], [6], [33], [13], 
[7], [36], [24], [1]. _ ^ 

These approaches mainly give a reduction of the basic primal problem to the solution of the dual 
problem, but the constructive solution of the dual problem for general models of incomplete markets is 
itself demanding task. 

Our goal is to derive a semimartingalc Bellman equation (a stochastic version of the Bellman equa- 
tion) related directly to the basic (or primal) optimization problem and to give constructions of optimal 
strategies. Applying the dynamic programming approach directly to the primal optimization problem 
may in many cases represent a valuable alternative to the commonly used convex duality approach. 

Let S be an i? d -valued continuous semimartingalc, defined on a filtered probability space satisfying the 
usual conditions. The process S describes the discounted price evolution of d risky assets in a financial 
market containing also a risklcss bond with a constant price. To exclude arbitrage opportunities, we 
suppose that the set M e of equivalent martingale measures for S is not empty. Since S is continuous, 
the existence of an equivalent martingale measure implies that the structure condition is satisfied, i.e., S 
admits the decomposition 

t t 

S t = M t + J d(M) s X s , J X' s d{M) s \ s < oo for all t a.s., (1.5) 
o o 

where M is a continuous local martingale and A is a predictable i? d -valued process. 

We consider utility function U mapping R + = (0, oo) into R. It is assumed to be continuously 
diffcrcntiablc, strictly increasing, strictly concave and to satisfy the Inada conditions: 

U'(0) = lim U\x) = oo, 

x— >0 

[/'(oo) = lim u\x) = 0. 

x — >oo 

We also set U({)) = lim^^o U(x) and U(x) = — oo for all x < 0. 

Denote by M e the set of martingale measures for S. Throughout the paper we assume that 

M e + 0. 

For any x G R+, we denote by the class of predictable S'-integrable processes it such that the 
corresponding wealth process is nonnegative at any instant, that is = x + j Q ir u dS u > for all 

te[o,T\. 

For simplicity in introduction we consider the case with one risky asset. 

Let us introduce the dynamical value function of the problem (1.4) defined as 

T 

V(t,x) = esssup E(U(x + / n u dS u )/ 'F t ). (1.6) 

t 

The classical Ito formula (or its generalization by Krylov 1980) plays a crucial role to derivation of 
the Bellman equation for the value function of controlled diffusion processes. For our purposes the Ito 
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formula is not sufficient since the function V depends also on to, even if U is deterministic. Therefore the 
Ito-Ventzel formula should be used. 

Under some regularity assumptions on the value function (sufficient for the application of the Ito- 
Ventzell formula) we show in Theorem 3.1 that value function defined by (1.6) satisfies the following 
backward stochastic partial differential equation (BSPDE) 

V(t,x) = V{0,x) + l f (Ms, X ) + Ks)V x (s, X )r d{M)s (L?) 



t 

- J (p(s,x)dM s + L(t,x) 



+ 



with the boundary condition 

V(T,x) = U(x), 

where J * (p(s,x)dM s + L(t,x) is the martingale part of V(t,x), L(t,x) is strongly orthogonal to M for 
all x and subscripts (p x ,V x , V xx stand for the partial derivatives. Moreover, the strategy 7r* is optimal if 
and only if the corresponding wealth process X n is a solution of the following forward SDE 

yn* yn* / <Px(u, X£* ) + \(u)V x (u, X£* ) 

Xt - Xa -J v xx ( S ,xn dSu - (L8) 



Thus, to give the construction of the optimal strategy one should: 

1) first solve the backward equation (1.7) (which determines V and ip simultaneously) and substitute 
corresponding derivatives of V and ip in equation (1.8), then 

2) solve the forward equation (1.8) with respect to X n and, finally, 

3) reproduce the optimal strategy tt* from the corresponding wealth process X^ . 

Theorem 3.1 is a verification theorem, since we require conditions directly on the value function V and 
not only on the basic objects (on the model and on the objective function U). Therefore we can't state 
that the solution of equation (1.7) exists, but for standard utility functions (e.g., for power, exponential, 
logarithic and quadratic utilities) all conditions of Theorem 3.1 are satisfied and in these cases the 
existence of a unique solutions of corresponding backward equations follows from this theorem. 

If U(x) =i p ,p£ (0, 1), then (1.4) corresponds to power utility maximization problem 

T 

to maximize E(x + J n u dS u ) p overall tt e IT;. (1.9) 

o 

In this case V(t, x) — x p V tl where V t is a semimartingale and all condition of Theorem 3.1 are satisfied. 
This theorem implies that the process V t satisfies the following backward stochastic differential equation 
(BSDE) 

V t = V + lj ^ + ^ 2 d(M) s 
o 

t 

+ j ip s dM s + L u V T = 1, (1.10) 
o 

where q = and L is a local martingale strongly orthogonal to M. 
Besides, equation (1.8) is transformed into a linear equation 

t 



x; = x + (i- q )J ^±^ x* u ds u (i.ii) 



for the optimal wealth process. 
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Therefore, 

X* t =x£ t {{l-q){^+X)-S) 
and the optimal strategy is of the form 

< = x(l - q)(^ + X t )£ t ((l - q)(£ + A) • S). 

Equations of type (1.10) was derived in [30] in relation to utility maximization problem and in [16] for 
constrained utility maximization problem. In comparison to the work [16] our results are at the same 
time more and less general. In [16] diffusion market model is considered and the boundedness of model 
coefficients is assumed. We are working with a general right-continuous filtration and under weaker 
boundedness conditions, but we have not included constraints on our strategies. 

We consider also utility functions which take finite values on all real line, such as the exponential utility 
U(x) = 1 — e^ x . For this case Theorem 3.1 is not directly applicable. It needs a special choice of a class 
of trading strategics and additional assumption of the existence of the dual optimizer (see Schachermayer 
2003). Exponential utility maximization problem we consider in section 4 and distinguish cases when 
this problem admits an explicit solution. In section 4 we consider also the case of quadratic utility. 

The main tools of the work - Backward Stochastic Differential Equations, have been introduced by J. 
M. Bismut in [2] for the linear case as the equations for the adjoint process in the stochastic maximum 
principle. In [3] and [34] the well-posedncss results for BSDEs with more general generators was obtained 
(see also [10] for references and related results). The scmimartingale backward equation, as a stochastic 
version of the Bellman equation in an optimal control problem, was first derived in [3] by R. Chitashvili. 

The main results of this paper are based on the papers of authors [31], [30]. 

2. Basic assumptions and some auxiliary facts 

We consider an incomplete financial market model, where the dynamics of asset prices are described 
by an R d - valued continuous semimartingale S defined on a filtered probability space (O, F, T = {3~t,t G 
[0, T]),P) satisfying the usual conditions, where F = Tt and T < oo is a fixed time horizon. For all 
unexplained notations concerning the martingale theory used below we refer the reader to [17], [8], [28]. 

Denote by Ai e the set of martingale measures, i.e., the set of measures Q equivalent to P on Tt such 
that S is a local martingale under Q. Let Z t (Q) be the density process of Q with respect to the basic 
measure P, which is a strictly positive uniformly integrable martingale. For any Q G M e there is a P- 
local martingale M Q such that Z(Q) = £{M®) = (£ t (M Q ), t E [0,T]), where £{M) is the Doleans-Dade 
exponential of M. 

We recall the definition of BMO-martingales and the Muckcnhoupt condition. 

The square integrable continuous martingale M belongs to the class BMO if there is a constant C > 
such that 

E((M) T - (M) T \F T ) < C, P-a.s. 

for every stopping time r. 

A strictly positive uniformly integrable martingale Z satisfies the Muckcnhoupt inequality denoted by 
A a (P) for some 1 < a < oo, iff there is a constant C such that 

E((^-)^\F T )<C, P-a.8. 

for every stopping time r. 

Note that, if the mean variance tradeof (A • M)t is bounded, then the density process £{— A • M) of 
the minimal martingale measure satisfies the Muckenhoupt inequality for any a > 1. 

The following assertion relates BMO and the Muckenhoupt condition. 

Proposition 2.1. ([9], [21]). Let M be a local martingale and £(M) its Doleans Exponential. The 
following assertions are equivalent: 
(i) M belongs to the class BMO, 
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(ii) £ (Ai) is a uniformly integrable martingale satisfying the Muckenhoupt inequality A a {P) for some 
a>l. 

Let Ila; be the space of all predictable S-integrable processes ir such that the corresponding wealth 
process is nonnegative at any instant, that is x + f* Tr u dS u > for all t e [0, T]. 

In the sequel sometimes we shall use the notation (ir ■ S) t for the stochastic integral J Q ir u dS u . 

By /z K we shall denote the Dolean's measure of an increasing process n. 

Suppose that the objective function U{x) = U(uj,x) satisfies the following conditions: 

Bl) V(0, x) < oo for some x, 

B2) U(u),x) is twice continuously differentiable and strictly concave for each u), 

B3) optimization problem (1.4) admits a solution, i.e., for any t and x there is a strategy n*(t, x) such 
that 

T 

V(t,x)=E(U(x + J w* s (t,x)dS s )/F t ) (2.1) 
t 

Remark 2.1. As shown by Kramkov and Schachermayer (1999), sufficient condition for B3), when U 
does not depend on w, is that utility function U{x) has asymptotic elasticity strictly less than 1, i.e., 

AE(U) = limsup < i. (2.2) 

x^oo U(X) 

It follows from Kramkov and Schachermayer (2003) that for B3) the finitness of the dual value function 
is also sufficient. 

Remark 2.2. The strict concavity of U implies that the optimal strategy is unique if it exists. Indeed, 
if there exist two optimal strategies ir 1 and 7r 2 , then by concavity of U the strategy tt = ^tt 1 + ^tt 2 is 
also optimal. Therefore, 



l -E[U{x + J ^ s dS s )\T t ]+ l -E[U{x + J TT 2 s dS s )\T t ] 
t t 

T 

= E[U(x + j ' * B dS„)\F t ] 



and 



\u{x + J irldS s ) + X -U{x + J ir 2 s dS s ) 



1 

= U(x + Jn s dS s ) P 



a.s. 



Now strict concavity of U leads to the equality J t nldS s — J t ir 2 dS s . 
For convenience we give the proof of the following known assertion. 

Lemma 2.1. Under conditions Bl)-B3) the value function V(t, x) is a strictly concave function with 
respect to x. 

Proof. The concavity of V(t, x) follows from B2) and B3), since for any a, (i G [0, 1] with a + (3 = 1 
and any x\ , x 2 £ R we have 

aV(t, Xl ) +/3V(t,x 2 ) 

T T 

= aE{U(x 1 + J w* u (t,x 1 )dS u )\F t ]+f3E[U(x 2 + J n* u {t,x 2 )dS u )\F t ] 
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T 

> E[U(a Xl +f3x 2 + J (an* u (t, Xl ) + (3n* u (t,x 2 ))dS u \T t ] 
t 

>V{t,a Xl +l3x 2 ). (2.3) 

To show that V(t, x) is strictly concave we must verify that if the equality 

aV(t, Xl ) + (3V(t, x 2 ) = V(t, axt + (3x 2 ) (2.4) 

is valid for some a, (3 £ (0, 1) with a + (3 = 1, then x\ = x 2 . 

Indeed, if equality (2.4) holds, then from (2.3) and the strict convexity of U follows that P-a.s. 

T T 



x 1 + J ■K* u {t,x 1 )dS u = x 2 + J nl(t,x 2 )dS u , 



t t 
which implies that xi = x 2 . 

Remark 2.3. The concavity of T^(0, x) and condition Bl) imply that V^(0, x) < oo for all x £ R + . 
Ito-Ventzell's formula. 

Let (Y(t,x), t £ [0, T], x £ R) be a family of special semimartingales with the decomposition 

Y(t, x) = Y(0, x) + B(t, x) + N(t, x), (2.5) 

where B(-,x) £ A\ oc and N(-,x) £ Mi oc for any x £ R. By the Galtchouk-Kunita-Watanabe (G-K- 
W) decomposition of N(-,x) with respect to M a parametrized family of semimartingales Y admits the 
representation 

t 

Y(t, x) = Y(0, x) + B(t, x) + J ip{s, x)dM s + L(t, x), (2.6) 

o 

where L(-,x) is a local martingale strongly orthogonal to M for all x £ R. 
Assume that: 

CI) there exists a predictable increasing process (K t ,t £ [0, T]) such that B(-, x) and (M) are absolutely 
continuous with respect to K, i.e., there is a measurable function b(t,x) predictable for every x and a 
matrix-valued predictable process v t such that 

t t 

B{t,x)= J b(s,x)dK s , (M) t = J v s dK s . 
o o 

Note that, by continuity of M the square characteristic (M) is absolutely continuous w.r.t. the continuous 
part K c of the process K and 

t t 



(M) t - J Vs dK c s = J v s dK s . 



o o 

id 



Without loss of generality one can assume that v is bounded and the scalar product u'v t v for u,v £ R 

we denote by (u, v) Vt . 

C2) the mapping x — > Y(t, x) is twice continuously diffcrcntiable for all (u),t), 
C3) the first derivative Y x (t, x) is a special semimartingale, admitting the decomposition 

t 

Y x (t,x)=Y x (0,x)+B {x) (t,x)+ J ^ x (s,x)dM s +L {x) (t,x), (2.7) 

o 

where Br x ^ (•, x) £ A\ oc , L/ x )(-, x) is a local martingale orthogonal to M for all x £ R and ip x is the partial 
derivative of ip at x (note that and L( x ) are not assumed to be derivatives of A and L respectively, 
whose existence does not necessarily follow from condition C2)), 
C4) Y xx (t, x) is RCLL process for every x £ R, 

C5) the functions b(s, •), ip(s, ■) and ip x (s, •) are continuous at x [i K -&.e., 
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C6) for any c > 

T 

E / sup g(s,x)dK s < oo 

J |x|<c 


for g equal to |?/>| 2 and \ip\ x - 

In what follows we shall need the following version of Ito-Ventzell's formula 

Proposition 2.2. Let (Y(-,x), x S R) be a family of special semimartingales satisfying conditions 
Cl)-C6) and I" = x+n-S. Then the transformed process Y(t,X^), t s [0, T] is o special semimartingale 
with the decomposition 

Y(t,X?) = Y(0,c) + B t + N t , 

where 

t 

B t = J [Y x (s,X*)\' s d(M) s Tr s +i> x (s,X*yd(M) s n s + 
o 

t 

+ ^Y xx (s,X:y s d(M) s n s ] + J b(s,X*)dK a (2.8) 

o 

and N is a continuous local martingale. 

One can derive this assertion from Theorem 1.1 of [26] or from Theorem 2 of [4]. Here we don't require 
any conditions on L(t,x) imposed in [26] and [4], since the martingale part of substituted process X 7 ' is 
orthogonal to L{-,x) and since we don't give an explicit expression of martingale part N, which is not 
necessary for our purposes. 

Remark 2.4. Since the semimartingale S is assumed to be continuous and is of the form (1.5), only 
the latter term of (2.8) may have the jumps, i.e., the process K is not continuous in general. 



3. The BSPDE for the value function 

In this section we derive a backward stochastic PDE for the value function related to the utility 
maximization problem. 

Denote by V 1 ' 2 the class of functions Y : x [0, T] x R — > R satisfying conditions Cl)-C6). 
Let us consider the following backward stochastic partial differential equation (BSPDE) 

Y(t,x) =Y(0,x) 

+ \ J ^^^^-^^^^-^- rf(M)g(^ x (s,a;) + \{s)Y x (s,x)) 
o 

t 

+ j \p(s,x)dM s + L(t,x), L(-,x)±M, (3.1) 

o 

with the boundary condition 

Y(T,x) = U(x). (3.2) 
We shall say that Y solves equation (3.1), (3. 2) if: 

(i) Y(u>,t, x) is twice continuously diffcrcntiable for each (ui,t) and satisfies the boundary condition 
(3.2), 

(ii) Y(t,x) and Y x (t,x) are special semimartingales admitting decompositions (2.6) and (2.7) respec- 
tively, where ip x is the partial derivative of ip at x and 
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(iii) P— a.s. for all x G R 

t 

B ( t ^ x ) = ^ / 77-7 x d{M) s (ip x (s,x) + X(s)Y x (s,x)) (3.3) 

^ J I xx ( S ,X) 



Remark 3.1. If we substitute expression of B(t, x), given by equality (3.3), in the canonical decom- 
position (2.6) for Y we obtain equation (3.1). 

Remark 3.2. A sufficient condition for twice differentiability of the value function V(0,x) is given in 
Kramkov and Sirbu [22]. 

According to Proposition Al the value process V(t,x) is a supermartingale for any x G R, which 
admits the canonical decomposition 

t 

V(t, x) = V(0, x) + A(t, x) + J ip(s, x)dM s + m(t, x), (3.4) 



where —A(-, x) 6 A + and m(-, x) is a local martingale strongly orthogonal to M for all x G R+. 

Assume that V £ V 1 ' 2 . This implies that V x (t, x) is a special semimartingale with the decomposition 



t 



V x (t, x) = V x (0, x) + A {x) {t, x) + J ip x (s,x)dM s +m( x )(t,x), (3.5) 



where A^(-, x) e A\ oc , m^(-, x) is a local martingale orthogonal to M for all x £ R + and <p x coincides 
with the partial derivative of ip ( ^i K -a.e.). Besides 

t 



A(t,x) = J a(s,x)dK s 



for a measurable function a(t,x). 

Recall that the scalar product u'v t v for u,v G R d we denote by (u, v) Vt . 

Proposition 3.1. Assume that conditions Bl), B2) are satisfied and the value function V(t,x) belongs 
to the class V 1 ' 2 . Then the following inequality holds 

f x ^ 1 \<Px(s,x) + \(s)V x (s-,x)\l a 
a(S > X) -2 V^^x) (3 ' 6) 

for all x e R + \i K — a.e. Moreover, if the strategy ir* is optimal then the corresponding wealth process 
X 71 is a solution of the following forward SDE 

X f . XJ' - / ,3.7, 



Proof. Using Ito-Ventzell's formula (Proposition 2.2) for the function V(t, x,uS) G V 1,2 and for the 
process (x + J s Tr u dS u , s < t < T) we have 

t 

V{t,x + J n u dS u ) (3.8) 

5 

t U 

=V(s,x) + J a(ii,x + J 7r v dS v )dK u 

s s 
t u 

+ J G(u,w u ,x + J TT v dS v )dK u + N t -N s , 
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where 



G(t,p,x,u) = V x (t-,x)p'v t X{t) + pv t Lp x {t,x)+ 

+ ^y xx {t-,x)p'v t p 

and N is a martingale. Since by Proposition Al of Appendix the process 

(V(t, x + J s n u dS u ), t G [s, T]) is a supermartingale for all s > and n G U x , the process 



(3.9) 



-J G(u,n u ,x + J n v dS v ) + a(u, x + J n v dS v ) 

S L S S 

is increasing for any s > 0. Hence, the process 



G(u, tt u ,x+ / TT v dS v ) + a(u, x + / n v dS v ) 



dK u , 



is also increasing for any s > 0, where K = K c + K d is a decomposition of K into continuous and purely 
discontinuous increasing processes. Therefore, taking r s (e) = mf{t > s : K£ — K c s > e} instead of t we 
have that for any e > and s > 

r s (e) u 
— J a(u,x + J i: v dS v )dK c a 



e 

Ts(e) 



< 



— ^ J G(u,tt u ,x + J n v dS v )dK°. 



(3.10) 



Passing to the limit in (3.10) as e — ► 0, from Lemma B of [31] we obtain that 

a(s,x) < —G(s,n s ,x) [i K — a.e. 



for all rren. Thus 



On the other hand 



a(t, x) < essinf( — G(t, ir t ,x)) [i K —a.e. 

7ren 

. t( nu ^ \V x (t-,x)\(t)+<p x (t,x)\l t 
essmf ( - G(t,n t ,x)) = 2Vxx{t -,x) 

+essmf --V xx {t-,x)\w t + — 



(3.11) 



V xx (i •> 3?) 



|V x (t-,a;)A(t)+^(t,a:)|? 



2V'„( t -.,) ^ <" 2) 

Indeed, since V xx < equality (3.12) follows from Lemma A.l. Thus, from (3.11) and (3.12) we have 
that for every x G i?+ 



a(t, x) < 



\V x (t-,x)\(t)+<p x (t,x))\l t K 



2V xx (t-,x) 

Since fi K - a.e. a(t,x) > and {v ^ 0} = we obtain that 



fi a.e. 



, t x) < \V x (t-,x)X(t) +lfx (t,x)\l t iK 



H a.e. 



(3.13) 



2V xx {t-,x) 

Conditions C2) and C5) imply that inequality (3.13) holds /i K -a..e. for all x G R. 

Let us show now that if the strategy ir* is optimal then the corresponding wealth process is a so- 
lution of equation (3.7). Let 7r*(s, x) be the optimal strategy and denote by A t *(s, x) = x + f* 7r*(s, x)dS u 
the corresponding wealth process. 
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By the optimality principle the process V(t, x + f* 7r*(s, x)dS u ) is a martingale on the time interval 
[s,T] and the Ito-Ventzell formula implies that [i K -&.s. 

a(t, X*(s, x)) + (A t , 7r t (s, x)) Vt V x (t-, X*(s, x))+ 

( Vx (t,X*(s,x)),nt(s,x)U + ^\n* t (s,x)\l t V xx (t-,X:(s,x))=0. (3.14) 
It follows from (3.13) and (3.14) that [i K -&.e. 

Since V xx < 0, integrating the latter relation by dK u we obtain that 



J Vxx(U, A U (S, X)) 

s 

x ( <{s ,x) + ^K^(y)) + A(^ (,,^(^)) ) = Q (3 15) 

The Kunita-Watanabe inequality and (3.15) imply that the semimartingalc 

t 

nu[S ' X) + V xx (u,X*(s,x)) ^ 

s 

is indistinguishable from zero (since its <S 2 -norm is zero) and we obtain that the wealth process of it* 
satisfies equation 

t 

Y *( 9 ^-r f ^ U ' X u( S > X )) + K^Wx (u, X* (a, x)) 

s 

which gives equation (3.7) for s = 0. □ 

Recall that the process Z belongs to the class D if the family of random variables Z T I^ T<T - ) for all 
stopping times r is uniformly integrable. 

Under additional condition 
C*) (Xt(s,x), t > s) is a continuous function of (s,x) P~ a.s. for each t <E [s,T], 

we shall show that the value function V satisfies equation (3.1)-(3.2). 

This condition is satisfied, e.g., if the optimal wealth process 
(X£(s,x), t > s) does not depend on s and x, which we have in cases of power, logarithmic and 
exponential utility functions. 

Theorem 3.1. Let V G V 1 ' 2 and assume that conditions Bl)-B3), C*) are satisfied. Then the value 
function is a solution of BSPDE (3.1)-(3.2), i.e., 

t 

V(t,x) = V(0,x) + \( ^'^^^^' dm^^x) + X(s)V x (s,x)) 

^ J v xx [S, X) 







t 



+ J tp(s,x)dM s +m(t,x), V(T,x) = U{x). (3.17) 
o 

Moreover, the strategy tt* is optimal if and only if the corresponding wealth process X 7 * is a solution of 
the forward SDE (3.7), such that the process V(t, X 7 * ) is from the class D. 
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Proof. Let n*(s,x) be the optimal strategy. By optimality principle (V(t, X£(s, x)), t > s) is a 
martingale. Therefore, using Ito-Ventzell's formula, taking (3.15) in mind, we have 

t 

[a(u,X*(s,x)) - g(u,X*(s,x))+ 



I 



v \ i v x(u,X*(s,x))X{u) +ip x (u,X*( Sl x)) }2 n 

+ 7r (s, a;H — — 7 — r-77 rr L \dK u = U, 

1 V xx (u,X*(s,a;)) 



where 



g{s,x) = 



for all i > s P — a.s., 

1 \ip x (s,x) + X(s)V x (s,x)\l 



2 V xx (s,x) 
It follows from (3.15) that fi K — a.e. 

V x (u,X*(s,x))X(u) +ip x (u,X*(s,x)) ,2 



Wl(s,x) + 



and by (3.6) 
Thus, 



V xx (u,X*( Sl x)) l"« 
o(s, x) < g(s, x) fi K — a.e. (3.18) 



y [a(«,X;(a,a:))-5(«,X;(s,a:))](iK- u = ) t >s P 



This implies that (a(s, x) — g(s, x))(K s — K s _) = for any s e [0, T}. Therefore, 

a(s, x) = g(s, x) /j, k —a.e. (3.19) 

On the other hand 

T 

J -J [a(u,X:( S ,x))-g(u,X:(s,x))]dK c u dK c s = 0, P- a.s. 

s 

and by Proposition B of [31] we obtain that 

T 



[a(s,x) — g(s,x)]dKg = 0, P - a.s. 
Now (3.18), (3.19) and the latter relation result equality a(s,x) = g(s,x) \i K — a.e., hence 
A(t,x) = \ f fr'fr % + *^ ^ d<M x) + X(s)V x (s, x)) 

£ J * XX \S, X) 



and V(t,x) satisfies (3.1)-(3.2). 

If 7T is a strategy such that the corresponding wealth process X 7 * satisfies equation (3.7) and V(t, X£) 
is from the class D, then tt is optimal. Indeed, using the Ito-Vcntzcll formula and equations (3.7) and 
(3.17) we obtain that V(t, X£) is a local martingale, hence a martingale, since it belongs to the class D. 
Therefore 7r is optimal by optimality principle. □ 

Remark 3.3. For the utility functions which take finite values on all real line Proposition 3.1 and 
Theorem 3.1 are also true if we choose a suitable class of trading strategies. E.g., let ILj be one of the class 
introduced by Schachermayer (2003) (Hi(x) or H^x), for i = 1,2 or 3). The proof of abovementioned 
assertions is the same, there is a minor difference only in the proof of equality (3.12), where instead of 
Lemma A.l the following arguments should be used: Conditions (C3), (C4) and (C6) imply that for each 
x the process 

V x (t-,x)X(t) + <p x (t,x) 
V xx [t , x) 
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is predictable and S'-integrable. Therefore, there exists a sequence of stopping times (r„(x),n > 1) with 
T n (x) | T for all x £ R such that the wealth process corresponding to the strategy 

V x (t-,x)X(t)+cp x (t,x) 

** =- I[0 > T " ] vZFrf 

is bounded and hence 7r" £ H for each n. Therefore, 
< ess mf - -V xx (t- , x) \w t + 



,/ 1„ ,. , V r a (f-,a;)A(f) +y a; (f,x) |2 \ K <= 
< ^-^^(t-^)! VU^) LJ J (r B (x)<t) - 0, fj, a.s., 

which implies equality (3.12). 

Theorem 3.2. Let conditions Bl)-B3) be satisfied. If the pair (Y,X) is a solution of the Forward- 
Backward Equation 

Y{t,x) = U{x) (3.20) 

T 

1 f {(4>x{S,X) + \(S)Y X (S,X)Y ,, , , . . w Nxr / 

7; -rf(M) s (^(s,a ; ) + A( S )^( S ,a ; )) 

t 

T 



2 J ^a:a:('5? 3-) 

t 

T 

y V(s, x)dM s + L(T, x) - L(t, x) 



t 



Xt = x r ^s.x,) + Y x M)Ms) dS- _ (321) 

J * xx \S> <^s ) 



X > 0, y G V 1,2 one? l"(i, <Y t ) belongs to the class D, then such solution is unique. 
Proof. Using the Ito-Ventzell's formula for Y(t, x + J s ir u dS u ) we have 



Y(t,x + J n u dS u ) (3.22) 

S 

t U 

= Y(s,x) + J b(u,x + J 7r v dS v )dK u 

s s 
t u 

+ j G(u,n u ,c + J n v dS v )dK u + N t - N s , 

s s 

G(t,p,x,u) = Y x {t-,x)p'u t \{t) + p'v t ip x (t,x) + ]^Y xx {t- 1 x)p'v t p 

and N is a local martingale. 

Since Y solves (3.20), then equality (3.3) is valid, which implies that Y(t,x + f* ir u dS u ) is a local 
supcrmartingale for each ir £ II. 

Let r n = inf {t : Y(t, x + J s TT u dS u ) > n} A T. 1 ) Then by supermartingale property and the monotone 
convergence theorem we have 



where 



Y(s,x) >E(Y(r n ,x + J n u dS u )\F s 



1 ) It is assumed that inf = oo and a A b denotes min{a, 6} 
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1 1 

>E(nAU(x + J 7r u dS u )\T s ) n ^ E(U{x + J n u dS u )\T s ). 



i.e. 



Y{s,x) > E(U(x + jn u dS u )\F s ), Vtt G U x , 

s 

which implies that 

Y(s,x) >V(s,x). (3.23) 

Using now the Ito-Ventzell's formula for Y(t, X t ) taking into account that Y satisfies (3.20) and X solves 
(3.21) we obtain that Y(t, X t ) is a local martingale and, hence, it is a martingale, since Y(t, X t ) is from 
the class D. 

Therefore, since X = x, Y(T,x) = U(x) we have that 

Y(t,x)=E(U(x- ] Y ^ X f; + ^^ dS u )/F t ). (3.24) 

J *xx ( u : SLu ) 

t 

Since - Hu)YA Y^xt)) (U,Xu) e from ( 3 ' 23 ) and ( 3 - 24 ) wc obtain that 

Y(t,x) = V(t,x), (3.25) 

hence solution of (3.20) is unique if it exists and coincides with the value function. This implies that 
under conditions of theorem V G V 1,2 . 

Therefore, it follows from (3.25) and (3.21) that X satisfies equation (3.7). Besides, according to 
Proposition 3.1 the solution of (3.7) is the optimal wealth process, hence X = X v * by the uniqueness of 
the optimal strategy for the problem (1.4) (see Remark 2.2). 



4. Utility maximization problem for power, logarithmic and exponential utility 

functions 



In this section we calculate the value function and give constructions of optimal strategies for the 
utility maximization problem corresponding to the cases of power, logarithmic and exponential utility 
functions. 

Power Utility. 

Let U(x) = x p , p G (0, 1). Then (1.4) corresponds to power utility maximization problem 

T 

to maximize E{x + J n u dS u ) p over all tt G LT x (4.1) 
o 

where is a class of admissible strategies. 

In this case the value function V(t, x) is of the form x p Vt, where Vt is a special semimartingale. Indeed, 
since LT^ is a cone (for any x > the strategy tt belongs to iff - G IT) , we have 



V(t, x) = ess 

t 

T 

= .T p esssup£((l+ / —dS u ) p /T t )=x p V u 
■rren x J x 
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where 



i 

V t = esssup£((l + UudSuY/Tt) 



t 

is a supermartingale by optimality principle. 

Let Vt = Vo + A t + Nt be the canonical decomposition of Vt , where A is a decreasing process and N 
is a local martingale. Using the G-K-W decomposition we have that 

t 

V t = Vo + A t + J Vs dM s + Lt, (4.2) 
o 

where L is a local martingale with < L, M >= 0. 

It is evident that for U(x) — x p the condition (2.2) is satisfied and the optimal strategy for the problem 
(4.1) exists. Since in this case V(t,x) — x p V t it is also evident that V(t,x) G V 1,2 and all conditions of 
Theorem 3.1 are satisfied (note that one can take —A + (M) as a dominated process K). 

Therefore we have the following corollary of Theorem 3.1 

Theorem 4.1. IfU(x) = x p ,p G (0,1), then the value function V(t,x) is of the form x p Vt, where Vt 
satisfies the following backward stochastic differential equation ( BSDE) 

t 



y t = Vo + gj &s + W' d{M)s{Vs + XsVs) 




t 

<fi s dM s + L t , V T = 1, (4.3) 



o 



where q = and L is a local martingale strongly orthogonal to M . 
Besides, the optimal wealth process is a solution of the linear equation 

t 



o 

Therefore, 



X* t =x-{q-l)j ^ + ^ uVu X:dS u (4.4) 



X* t =x£ t {-{q-l){^+\)-S) 
and the optimal strategy is of the form 

< = -x(q l)£ t (-(q 1)(^ + A) • S)(^ + X t ). 

Remark 4.1. If there is a martingale measure Q that satisfies the Muckcnhoupt condition A a (P) for 
a = | then the process V is bounded. Indeed, by the Holder inequality for any it g LT 

t T Q 

E((l + J MWt)=S Q ((l + J K u dS u ) p ^\T t ) < 
t t T 

T 

< (EQ((1 + J n u dS u )\Ft)) P (EQ((Z?/zQ)^\T t )) 1 - p < 

t 

<{E({Z?/Z$)t^)\F t )f 
Under condition Ai(P) equation (4.3) admits a unique bounded strictly positive solution. This follows 

V 

from Theorem 3.2, since in this case the process £ t (—(q — 1)(^ + A) • S) belongs to the class D. 
Now we shall consider two cases when equation (4.3) admits an explicit solution 
Case 1. 
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Let S t (q) = M t + q J* d(M) s X s and let Q(q) be a measure denned by dQ(q) = £ T (~qX ■ M)dP. Note 
that S{q) is a local martingale under Q{q) by Girsanov's theorem. 
Assume that 



T 



e ^(A.M> T =c+ / hudSu ( q)i (4.5) 





where c is a constant and h is a predictable S'((7)-integrable process such that h-S(q) is a Q(g)-martingalc. 

This condition is satisfied iff the g-optimal martingale measure coincides with the minimal martingale 
measure. For diffusion market models this condition is fulfilled for so called "almost complete" models, 
i.e., when the market price of risk is measurable with respect to the filtration generated by price processes 
of basic securities. 

Let condition (4.5) be satisfied. Let us consider the process 



Y t =(E(£l T (-\.M)/F t ))>-«. (4.6) 



Since 

condition (4.5) implies that 



£ q t {-\ ■ M) = £ t (-q\ ■ M)e^^ M ^ 



Y t = (E Q{q) (e £2 ^ 11{{x - M)T - {x - M)t / Ft)) 7 ^ 

t 

= e f<A.M> t ( c + J hudSu ( q ))T^. 



By the ltd formula 

t t 

r, = r° + 1 / r,x'AM),x, + ^ / 





and denoting c+ (fe?g( g )) by tp s we obtain that 

t t 
Y t =Y Q + lJ i^+^y ' d(M) a (i> a + X S Y S ) + J ^ s dM s . 



It is evident from (4.6) that Y T = 1. Thus the triple (Y, ip, L), where ip = c+ h.s( q ) ■ L = and ^ 
defined by (4.6), satisfies equation (4.3). 

Case 2. 

Assume that 

e -i(\. M ) T =c + mT) (4. 8 ) 

where c is a constant and to is a martingale strongly orthogonal to M. 

For diffusion market models this condition is satisfied when the market price of risk is measurable with 
respect to the filtration independent relative to the asset price process. 

Let us consider the process 

Y t = £( e -l«*- M >^-<A-M> t )/ Ft ). (4.9) 

Condition (4.8) implies that 

Yt =e2< A - M >'( c + m t ) 
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and by the Ito formula 

t t 
Y t = Y + ^J Y s d(X ■ M) s + J e^ x - M ^dm s . 
o o 

It follows from here that the triple (Y,ip,L), where ip = 0, L t = J Q * ei^ x ' M ^ e dm s and Y defined by (4.9), 
satisfies equation (4.3) and the optimal strategy is 

< = x(l - q)X t £ t ((l ~ q)X ■ S). 

Logarithmic Utility 

For the logarithmic utility 

U(x) — logx, x > 
the value function of corresponding utility maximization problem takes the form 

V(t,x) = logx + V t , 

where V t is a special semimartingale. 

Indeed, since for any x > the strategy tt belongs to II X iff ^ e IIi, we have 

T 

V(t,x) = esssup E(\og(x+ / n u dS u ) / Tt) 
7ren x J 
t 

T 

= esssup £(logx(l + / — dS u )/F t ) 
Tren^ J x 

t 

T 

= logx + esssup E(\og (l + / —dS u )/T t ) = logx + V t , 
«n, J x 

t 

where 

T 

V t = esssup £(log (1 + / ir u dS u )/T t ) 
ireni J 
t 

is a supermartingale by the optimality principle. 

It is also evident that all conditions of Theorem 3.1 are satisfied. In this case ip x (t, x) — 0, V x (t, x) — 
^,V xx (t, x) — — -i; and equation (3.7) gives the following expression for V t 

t 

V t = V -±{\- M) t + J <p s dM s + L t , 
o 

V T = 0, (4.10) 

which admits an explicit solution 

V t = ~E((X-M) T -(X-M)t/F t ). 
Thus, we have the following corollary of Theorem 3.1 

Theorem 4.2. IfU(x) = logx, then the value function of the problem is represented as 

V(t, x) = logx - ±E((X ■ M) T - (X ■ M) t /F t ). 

Besides, the optimal wealth process is a solution of the linear equation 

t 

X* t =x + J X u X*dS u . (4.11) 
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Thus, 

X* = x£ t (X-S) 

and the optimal strategy is of the form 

< = X t X; = x\ t £ t (X ■ S). 

Exponential Utility 

Let us consider the case of exponential utility function 

U(x) = - e -^- ff ) 

with risk aversion parameter 7 <E (0, 00), where H is a bounded contingent claim describing a random 
payoff at time T. We assume that H is bounded fr-measurable random variable. 

For any Q G Ai e let (zf, t G [0, T]) be the density process of Q with respect to P and assume that 

Mf B = {QeM e : EZ% lnZ® < 00} ^ 0. 

We define the space of trading strategies II as the space of all predictable 5-integrable processes tt such 
that the corresponding wealth process X* is a martingale relative to any Q G M\ n . So, II is the space 
62 from Delbaen et al. (2002) and the space H2 from Schachermayer (2003). 
Let us consider the maximization problem 

max£(- e - 7(x+ r^ ds "- ff )), (4.12) 

the maximal expected utility we can achieve by starting with initial capital x, using some strategy n G II 
and paying out H at time T. 

The corresponding value function 

V(t,x) = esssup E{ _ e -<(*+St ^d Su -H) (4 13) 
is of the form V(t,x) = —e~ lx Vt, where 

V t = essinf E(e-~< { $t ^ ds ^ H )\ Tt ) (4. 14) 

is a special semimartingale. 

Let Vt — Vo + A t + N t be the canonical decomposition of V t , where A is an increasing process and N 
is a local matingale. Using the G-K-W decomposition we have that 

t 

V t = V + A t + J <p s dM s + Lt, (4.15) 


where L is a local martingale with (L, M) = 0. 

Since Mf n ^ 0, the optimal strategy in the class II exists and V t > for all t (see, e.g., Delbaen at al. 
(2002) and Yu. Kabanov and Ch. Strieker (2002)). It is evident that V(t,x) = -e~i x V t G V 1 ' 2 and all 
conditions of Theorem 3.1 arc satisfied. 

Therefore, Theorem 3.1 and Remark 3.3 imply the validity of the following 

Theorem 4.3. The value function (4-13) is of the form —e~ lx V t , where V t satisfies the BSDE 

t t 
Vt^V + ^J b' + W'i d {M) s + J psdM s + L t (4.16) 


with the boundary condition 

V T = e^ H . 

where L is a local martingale strongly orthogonal to M . 
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Besides, the optimal wealth process is expressed as 

t 



X; = x+ I iPu+ ^ uVu dS u (4.17) 



o 



and the optimal strategy is of the form 

ft + hV t 



ir f = 



lV t 



Remark 4.2 It is evident that V t < E(e jH \F t ) < const. If there exists a martingale measure Q that 
satisfies the Reverse Holder RuogL condition, i.e., if 

for all t, then there is a constant c > such that V t > c for all t (see [7], [29]). Under RuogL condition 
the value process V is the unique bounded strictly positive solution of BSDE (4.16). 

Now we shall give explicit solutions of equation (4.16) in two extreme cases. 

Case 1. 

Assume that 

T 

7#-i<A-M> T = c+ J h u dS u , (4.18) 
o 

where c is a constant and h is a predictable S'-integrable process such that h • S is a martingale with 
respect to the minimal martingale measure. 

This condition is satisfied iff the minimal entropy martingale measure coincides with the minimal 
martingale measure and H is attainable. For diffusion market models this condition is fulfilled for so 
called "almost complete" models, i.e., when the market price of risk is measurable with respect to the 
filtration generated by price processes of basic securities. 

Similarly to the case of power utility one can show that the triple (V, tp,L), where 

Y t = e EQmin ^ H -^ M >^^\ i> t = Y t h t , L t = 
satisfies equation (4.16) and the optimal strategy is 

7T* = -(Xt+h t ). 

7 

Case 2. 
Assume that 

e7 ff-i(A.M} T = c + mT; ( 419 ) 

where c is a constant and to is a martingale strongly orthogonal to M. 

For diffusion market models this condition is satisfied when the market price of risk and H are mea- 
surable with respect to the filtration independent relative to the asset price process. 

One can show that the triple (Y, tp, L), where 

t 

y t = e s(7H-i(A.M> tT /F t ) 5 ^ t = , L t = J e^ X M ^dm s 

o 

satisfies equation (4.16) and the optimal strategy is 7r t * = ^A t . 
Quadratic Utility. 

Let U(x) = 2bx — x 2 , where & is a positive constant. 
Assume that 

Ml = M e : E(Z®) 2 < oo} + 0. 
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and let II be the space of all predictable 5-integrable processes tt such that n u dS u is in L 2 (P) and 
the stochastic integral J * ir u dS u is a martingale relative to any Q G M.%. 
In this case (1.4) corresponds to the utility maximization problem 

T T 

to maximize E[x + 2b J -K u dS u — ( J n u dS u ) 2 ] over all w G II, (4.20) 
o o 

which is equivalent to the problem 

T 

to minimize E(x + J n u dS u — b) 2 over all 7r G II. (4-21) 

o 

This is the mean variance hedging problem with a constant contingent claim. 

In this case the value function of (4.20) is of the form V(t, x) = b 2 — (x — b) 2 V tl where 



V t = ess £ mf£((l + J ir u dS u ) 2 /Tt) 



is a supermartingale by optimality principle. 

Let Vt — Vo + A t + N t be the canonical decomposition of V t , where A is an increasing process and iV 
is a local martingale. Using the G-K-W decomposition we have that 

t 

V t = Vo + A t + j Vs dM s + L t , (4.22) 
o 

where L is a local martingale with (L, M) = 0. 

Since M\ ^ 0, the optimal strategy in the class LT exists and V t > for all t (see, e.g., Gourieroux et 
al. 1998 or Heath ct al. 2001) . It is evident that V(t,x) = b 2 - (x - b) 2 V t belongs to the class V 1 ' 2 and 
all conditions of Theorem 3.1 are satisfied (again one can take A + (M) as a dominated process K) 

Therefore, Theorem 3.1 and Remark 3.3 imply the followin assertion 

Theorem 4.4. If U(x) = 2bx — x 2 ,b>0, then the value function V(t, x) is of the form b 2 — (x — b) 2 V t , 
where V t satisfies the BSDE 



t 

V t = V + J {ips+ ^ sVs) ' d(M) s (Vs + X S V S ) 



o 
t 

+ Jip s dM s + L t , V T = l. (4.23) 



o 

Besides, the optimal wealth process is a solution of the linear equation 

t 



X *t= x ~ j ^^y^ KdSu (4.24) 
o 

Therefore, 



X* t =x£ t {-{^+\)-S) 



and the optimal strategy is of the form 



T * = -x£t(-(^ + X)-S)(^ + Xt). 
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5. Diffusion market models 



The main task of this section is to establish a connection between the semimartingale backward 
equation for the value process and the classical Bellman equation for the value function related to the 
utility maximization problem in the case of Markov diffusion processes. For Markov diffusion models 
the value process can be represented as a space-transformation of an asset price process by the value 
function. The problem is to establish the differentiability properties of the value function from the fact 
that the value process satisfies the corresponding BSDE. The role of the bridge between these equations 
is played by the statements describing all invariant space-transformations of diffusion processes, studied 
in Chitashvili and Mania (1996) and formulated here in the appendix, in a suitable case adapted to 
financial market models. This approach enables us to prove that there exists a solution (in a certain 
sense) of the Bellman equation and that this solution is differentiable (in a generalized sense) under mild 
assumptions on the model coefficients. Although, in our case, the generalized derivative at t and the 
second order generalized derivatives at x do not exist separately in general (we prove an existence of a 
generalized L-operator), these derivatives do not enter in the construction of optimal strategies which are 
explicitly given in terms of the first order derivatives of the value function, ft should be noted that the 
theory of viscosity solutions is usually applied to such problems (see, e.g., El Karoui et al (1997)), but 
differentiability of the value function is in general beyond the reach of this method. 

We assume that the dynamics of the asset price process is determined by the following system of 
stochastic differential equations 

dS t =diag(St)(^(t,St,Rt)dt + a l (t,S t7 Rt)dWl) (5.1) 

dR t =b(t, S t , R t )dt + S(t, S t ,R t )dW l t + a ± (t, S t ,R t )dW t ^ (5.2) 

Here W = (W 1 , W n ) be an n-dimensional standard Brownian motion defined on a complete probability 
space (Q,F,P) equipped with the P-augmentated filtration generated by W, F = (F t ,t <G [0, T]). By 
W l = (W 1 , W d ) and W 1 - = (W d+1 , W n ) are denoted the d and n—d dimensional Brownian motions 
respectively. 
Assume that 

51) the coefficients /i, b, S, a 1 , a 1 - are measurable and bounded; 

52) n x n— matrix function aa' is uniformly elliptic, i.e., there is a constant c > such that 

(a(t,s,r)X,a(t,s,r)X) > c\X\ 2 
for alH G [0, T], s G R d + , r G R n ~ d and A G R n , where u is defined by 



( u\t,s,r) \ 
°V> a > r )- { 6(t,s,r) a^(t, S ,r), J ■ 



In addition we assume that 

S3) the system (5.1), (5.2) admits a unique strong solution. 
Straightforward calculations yield that in this case 



A = diag(STVV')-V, 



where a 1 denotes the transpose of a 1 , 



= diag(S t )(a l a l ')(t,S t ,R t )diag(S t ) 

dt 

is the v t process, 9 = (cr 1 )^ 1 ^ is the market price of risk and 

t 

(X-M)t = J \\0 s \\ 2 ds 
o 

is the mean variance tradeoff. 

By results of Krylov (1980) for sufficiently smooth coefficients n, a, b, S the value function V(t, x) can 
be represented as v(t,x, St, Rt) with sufficiently smooth function v{t,x, s,r), t G [0,T], x G R+, s G 
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R+, r e R n ~ d . Hence by the equation (3.1) and the Ito formula we obtain that v(t,x,s,r) satisfies the 
PDE 

Cv(t, x, s, r) + v s (t, x, s, r)' diag(s)/i(f, s, r) + v r (t, x, s, r)'b(t, s, r) (5.3) 

_ 1 \v sx (t, x, s, r) + diag(s)- 1 a l (t, s, r)- 1 6'(t, s, r)v rx (t, x, s, r) + X'(t, s, r)v x (t, x, s, r)\ 2 Vt 
2 v xx (t,x,s,r) 

v(T,x,s,r) = U(x), (5.4) 

which coincides with the Bellman equation of optimization problem (1.4), (5.1), (5. 2) for controlled Markov 
process. Moreover the optimal strategy is 

7T*(t, x, s, r) = 

v sx (t,x,s,r) + diag(s)-y'(£, s.rT 1 ^, s,r)v rx (t,x, s,r) + X'(t, s, r)v x (t, x, s, r) 

v xx (t,x,s,r) 

In this section we study the solvability of (5.3), (5.4) in the particular cases of utility functions but with 
weaker conditions on coefficients. 

First consider the case of power utility 

Theorem 5.1. Let condition SI), S2) and S3) be satisfied. Then the value function v(t,s,r) admits 
all first order generalized derivatives v s and v r , a generalized L- operator 

Cv =v t + -tr(diag(s)a l a l (t, s,r) di&g(s)v ss +tr(Sa l (t,r, s)diag(s)v sr ) 

+^tr{(6S'{t, s, r) + a^a 1 -' (t, s, r))v rr ) 

(in the sense of Definition D of the Appendix) and is the unique bounded solution of equation 

£v(t, s, r) + v s (t, s, r)'diag(s)fj,(t, s, r) + v r (t, s, r)'b(t, s, r) 

_ q \v s (t, s,r) + diag{s)~ 1 a 1 ' (t, s,ry 1 S' (t, s,r)v r (t, s,r) + X(t,s,r)v(t, s,r)\l t 
2 v(t,s,r) 
dtdsdr — a.e. (5-5) 

with the boundary condition 

v(T,s,r) = l. (5.6) 

Moreover, the optimal strategy is defined as 

n*(t, x, s, r) - (1 - q)(\(t, s, r) + ^4)* 

v{t,s,r)' 

and the optimal wealth process is of the form 

X*=x£ t ((l-q)(^+X).S), 

where ip(t, s, r) — v s (t, s, r) + diag(s) _1 (r' (t, s, r)~ 1 5'(t, s, r)v r (t, s, r). 

Proof. Existence. Since (5*, R) is a Markov process, the feedback controls are sufficient and the value 
process is expressed by 

V t = v{t,S u Rt) a.s. (5.7) 

where 

T 

v(t, s, r) = sup E((l + / TT u ds u ) P \S t = s,R t = r) . 
Trerii J 
t 

(one can show this fact, e.g., similarly to [5]). 
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Since the value process satisfies equation (4.3), it is an Ito process. From the equality 

£{— A • M) = £{— J Q 9 u dw l u ) and boundedness of 6 follows that £(— A • M) satisfies The Muckenhoupt 

inequality. Thus Vt — esssup E((l + Tt u dS u ) p / T t ) is bounded (see Remark 4.1)and the martingale part 

Trelli 

of V is in BMO by Proposition 7 from [29] . Hence the finite variation part of V t is of intcgrablc variation 
and from (5.7) we have that v(t,St,Rt) is an Ito process of the form (B.l) (Appendix). Therefore, 
Proposition B of the Appendix implies that the function v(t,s,r) admits a generalized L-operator, all 
first order generalized derivatives and can be represented as 

t 

v(t,S t ,Rt) = v + J \v s (u,S u ,R u )' diag(S u )a l (u,S u ,R u ) 
o 

+v r {u,S u ,R u yS{u,S u ,R u ))dW l s + J v r (u,S u ,R u )'cT ± {u,S u ,R u )dW^ 

o 

t t 
+ J Cv(u,S u ,R u )ds + J (v s (u, S u , R u )' diag(X s ) /j,(u, S U ,R U ) 
o o 

+ v r (u,S u ,R u )b(u,S u ,R u ))du, (5.8) 

where CV is the generalized ^-operator. 

On the other side the value process is a solution of (4.3) and by the uniqueness of the canonical 
decomposition of semimartingales, comparing the martingale parts of (5.8) and (4.3), we have that 
dt x dP- a.e. 

ipt =v s (t, S t , R t ) + diag(S t r V>, S t , Rt^S'it, S t ,R t )v r (t, S t ,R t ), (5.9) 
ipi =a ± '(t,St,Rt)v r (t,St,R t ). (5.10) 

Then, equating the processes of bounded variation of the same equations, taking into account (5.8) and 
(5.9), we derive 

t 

(Cv(u, S u , R u ) + v s (u, S u , R u )' di&g(S u )n(u, S u , R u ) 

n 

+v r (u, S u , R u )b(u, S u , R u ))du 

\p u + \(u, S u , R u )v(u, S u , Ru)\l u , 1 _ 

du (5-11) 



z 

I 



v(u,S u ,R u ) 



which gives that v(t,s,r) solves the Bellman equation (5.5). 

Unicity. Let v(t,s,r) be a bounded positive solution of (5.5), (5.6), from the class V L . Then using 
the generalized Ito formula (Proposition B of Appendix) and equation (5.5) we obtain that v(t,S t ,Rt) 
is a solution of (4.3), hence v(t,St,Rt) coincides with the value process v by Theorem 4.1. Therefore 
v(t, S t , Rt) = v(t, S t , Rt) a.s. and v = v, dtdxdy a.e. □ 

Now we consider extreme cases for the stochastic volatility models. Let first assume that coefficients 
fi, a 1 does not contain the variable r. Hence equation (5.1) takes the form 

dS t - diag(S t )(Mt, S t )dt + a\t, S t )dW l t ). (5.12) 

Let S(q) be the Ito process governed by SDE 

dSt(q) = di & g(St(q))<J l (t,St(q))(dWl+q8(t,S t (q))dt), (5.13) 

where dW\ + q9(t,S t )dt is Brownian motion w.r.t. measure dQ(q) = £r(—q f o u dw l u )dP. Thus by 4.6 
the value process is represented as 

V t = v(t,St(q)) = (v(t,S t (q))^, 
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where v(t,s) — (e 5 /« = s). Therefore we have 

Corollary 5.1. Let conditions SI), S2) and S3) be satisfied for the coefficients of system (5.13). Then 
the value process can be represented as (v(t, Stiq)) 1 ^ , where v(t,s) is the classical solution of the linear 
PDE 

vt{t, s) + -ir(diag(s)oV (t, s) diag(s)v ss (i, s)) 

+ ^ Y ^\0(t,s)\ 2 v(t,s)=O, (5.14) 

v(T,s) = l. (5.15) 
The second extreme case corresponds to the stochastic volatility model of the form 

dS t = diag(5 t )(^(i, S u R t )dt + a\t, S t , R t )dW l t ) 

dR t =b(t, R t )dt + a^(t, Rt)dWj-. (5.16) 

Corollary 5.2. Let conditions SI), S2) and S3) be satisfied for the coefficients of the system (5.16) 
and 9 does not depend on the variable s. Then the value process of the optimization problem (4-1) is of 

the form V t = v(t,R t ), where v(t,r) = E(e~% L \ e ^ R ^\ 2du \ Rt = r ) satisfies the linear PDE 

v t {t,r) + ^tr(a- L a 1 -' (t,r)v rr (t,r)) 

+v r (t,r)'b(t,r) - l\d(t,r)\ 2 v(t,r) = 0, (5.17) 

v(T,r) = l. (5.18) 
Similar results can be obtained for exponential utility function. 

Proposition 5.1. Let conditions SI), S2) and S3) be satisfied and H = g(ST,Rr) for a continuous 
bounded function g{s,r). Then the value function v(t,s,r) for the problem (4-12) admits all first order 
generalized derivatives v s and v r , a generalized L-operator and is the unique bounded solution of equation 

Cv(t, s, r) + v s (t, s, r)' diag(s)/x(i, s, r) + v r (t, s, r)'b(t, s, r) 
_ 1 \v s (t,s,r) + diag{s)~ 1 a 1 ' (t, s,ry 1 S' (t, s,r)v r (t, s,r) + A(f, s,r)v(t, s,r)\l t 
~ 2 v(t,s,r) 

dtdsdr — a.e. (5.19) 

with the boundary condition 

v{T,s,r) = e-~< g ( s > r \ (5.20) 
Moreover, the optimal strategy is defined as 

1 v{t,s,r)' 

where ip(t,s,r) — v s (t,s,r) + diag(s)~ 1 a 1 ' (t,s 1 r)^ 1 S'(t,s 1 r)v r (t,s,r) and the optimal wealth process is 
defined by (4-17). 

The following assertion, for the case of logarithmic utility, follows immediately from Theorem 4.3 and 
the Feynmann-Kac formula: 

Proposition 5.2. Let condition SI), S2) and S3) be satisfied and U(x) = logx. Then the value 
function can be represented as v(t, S t , Rt), where v(t,s,r) is unique solution of linear PDE 

Cv(t, s, r) + v s (t, s, r)' diag(s)/x(t,s, r) 

+v r (t,s,r)'b(t,s,r) + \9(t, s,r)\ 2 v(t, s,r) = 0, (5.21) 

v(T,s,r) = l (5.22) 

and the optimal strategy is 7r*(t, x, s, r) = A(t, s, r)x. 
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Appendix A 

Let us show that the family 

T 

A?" =E(U(x + j TT u dS u )\T t ), neU x (n,t,T) (A.l) 
o 

satisfies the e-lattice property (with e = 0) for any t G [0, T] and 7r. U(n,t,T) is a set of predictable 
5*-integrable processes tt from such that 

We shall write T) instead of LT(0, t, T) for the class of strategies corresponding to % = up to time t. 
We must show that for any it 1 , tt 2 G H(tt, t, T) there exists a strategy 7r G H(tt, t, T) such that 

A- = max(Af,Af). (A.2) 

For any tt 1 and tt 2 let us define the set 

B = {co: Af < Af } 

and let 

7T S = 7f s /( < s <t) + Trll B I(s>t) + K 2 lBcI{ s >i) 

It is evident that 

if 7r, 7T 1 , 7r 2 G II X , then 7r G II X . (A. 3) 

Since B is J^— measurable we have 

T 

= E(U(x + J n u dS u )\Tt) 
o 

t T T 

= E(U(x + J n u dS u + I B j nidSu + Iec J n 2 u dS u )\F t ) 
o t t 

t T t T 

= I B E(U(x + j Tr u dS u + J nldS u )\F t )+I B cE(U(x + J n u dS u + J ir 2 u dS u )\T t ) 

t T t 

T T 

= I B E(U(x + J Tr 1 u dS u )\T t )+I B cE(U(x + J 7r 2 u dS u )\T t ) 


T T 

= E(U(x + J ir 1 u dS u )\T t )VE(U(x + J n 2 u dS u )\F t ), 
o o 

hence (A.2) is satisfied. 

Proposition Al) (Optimality principle). Let condition Bl) be satisfied. 

a) For all x G R, it G IT and s G [0,T] the process {V(t,x + Tr u dS u ), t > s) is a supermartingale, 



admitting an RCLL modification. 



b) 7r*(s, x) is optimal iff (V(t,x + J s TT^dS u ),t > s) is a martingale. 

c) for all s < t 

t 

V(s,x) = ess sup E(V(t,x + / Ti u dS u )\T s ). (A.4) 



BACKWARD STOCHASTIC PDE 25 

Proof, a) For simplicity we shall take s equal to zero. Let us show that Y t = V(t,x + J^TT u dS u ) is 
supermartingale for all x and n. Since 

t T 

Y t = esssup E(U(x + / n u dS u + / -KudSu)^) 
n-en(t,T) J J 

o t 

using the lattice property of the family (A.l) from Lemma 16. A. 5 of [11] we have 

t T 

E{Y t \F s ) = E(esssupE(U(x + ( n u dS u + [ n u dS u )\F t )\T s ) 
n-en(t,T) J J 

o t 

T 

= E( esssup 

7ren(7f,t,T) J 





T 



= esssup E(U(x+ / -KudSu^Tg). (A.5) 

7ren(-M,T) J 
o 

It is evident that IT(7f , t, T) C n(7r, s, T) for s < t, which implies the inequality 

T 

esssup E(U(x+ \ -K u dS u )\T a ) 

7rGn(ir,t,T) J 





T 

< esssup E(U(x+ / ir u dS u )\T t ) 

7TGn(iT, 8,T) J 

o 

s 

= V(s,x + J n u dS u ). (A.6) 



o 

Thus (A.4) and (A.5) imply that E(Y t /F s ) < Y s . 
b) If V(t, x + J Q n^dS u )) is a martingale, then 



inf EU(x + I n u dS u ) = V(0,x) = EV(0,x) 





T 



= EV(T,x + J n* u dS u )=EU(x + J KdS u ), 



hence, ir* is optimal. 

Conversely, if tt* is optimal, then 

T 

EV(0,x) = sup EU{x+ / w u dS u ) 
uen J 
o 

T T 

= EU(x + J KdSu) = EV(T,x + j ' KdS u ). 



Since V(t,x + J Q Tr^dS u ) is a supermartingale, the latter equality implies that this process is a martingale 
(it follows from Lemma 6.6 of [27]). 
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c) Since Y t — V(t, x + f* w u dS u ) is a supermartingale for any 7r G U(s, T), x G R and i>swe have 



V(s,ar) >£(F(i,z + J n u dS u )\T s 



hence 



V(s,x) < esssup E(V(t,x + / 7f u dS u )|.F s ). (A.7) 
*en(s,T) 



On the other hand for any 7r 

t 

E(V(t,x + J K u dS u )\F s ) = 



esssup E(U(x+ / 7r u dS u + / n^Sy,)]^)^) > 
wen(t,T) J J 



t 

T 



E{E(U(x + J n u dS u )\F t )F s ) = E(U(x + J n u dS u )\T s ). 

s s 

Taking esssup of the both parts we obtain 

t 

esssup E(V(t, x + / TTudSu)^) > 
#en(s,T) J 

s 

T 

ess sup E(U{x+ / K u dS u )\T s ) = V(s,x). (A.8) 
#en(s,T) J 

s 

Thus the equality (A. 3) follows from (A. 6) and (A.7). 

Let us show now that the process V(t, x + J Q n u dS u ) admits an RCLL modification for each x G R and 

7r e fl. According to Theorem 3.1 of [27] it is sufficient to prove that the function EV(t, x+ J n u dS u )), t G 
[0,T]) is right-continuous for every x G R. 

Let (t„, n > 1) be a sequence of positive numbers such that t„ I t, as n — > oo. Since V(t,x + f* ir u dS u ) 
is a supermartingale, we have 

+ / ^ M d,5* M ) > lim EV(t n ,x+ / T^dS,,). (A.9) 
J J 
o o 

Let us show the inverse inequality. For s = equality (A. 4) takes the form 

t T 

EV{t,x+ / TT u dS u ) = max E(U(x + / n u dS u ). (A.10) 
J 7ren(#,t,T) J 

o o 

Therefore, for any e > there exists a strategy tt £ such that 

t t T 

EV{t,x + J n u dS u ) < E(U{x + J n u dS u + J w s u dS u ) + e. (A.ll) 

o o * 

Let us define a sequence (ir n ,n > 1) of strategies 

7T™ = 7T s /( a<tn ) + TT e s I(s>t n )- 
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Using inequality (A. 11), the continuity of U (it follows from Bl) and B2), the convergence of the stochastic 
integrals and Fatou's lemma, we have 

t t T 



EV(t,x + J n u dS u ) < E(U(x + J n u dS u + J n £ u dS u ) + e = 
o o t 

t„ T 

= E{YimU{x + j n u dS u + J n £ u dS u )) + e > 

t„ 
t n T 

> }m n E(E(U(x + J n u dS u + J -K e u dS u )/F tn )) + e > 

t„ 

tn T 

lim„£'( csssup E(U(x + / w u dS u + / K u dS u ) / F tn )) + e = 
7ren(ff,t„,T) J J 



t„ 



= ljm n ^ 00 E(V(t n ,x + J n u dS u )+e. (A.12) 
o 

Since e is an arbitrary positive number, from (A.12) we obtain that 

t t n 
EV(t, x + J n u dS u )) < Ijm^EVitn, x + J n u dS u )), (A.13) 



which together with (A. 9) implies that the function (EV(t,x + J Q n u dS u )),t <E [0,T]) is right-continuous. 
Lemma A.l. Let b t be a predictable process and S a continuous semimartingale. Suppose that JC is 



an adapted continuous increasing process and ijF the corresponding Dolean's measure. Denote by H x the 
space of all predictable S-integrable processes ir such that for all t G [0, T] 

t 

x + j ir u dS u > 0. 
o 

Then [i K a.e. 



essinf 7r t — b t \ =0 
7ren x 1 1 

Proof Taking a bounded continuous approximation of 6™ = &t/(|fc t |<„) in the sense of //"-a.e. 
convergence we have that 

essinf 7r t — b t \ < essinf 7r t — 6™' m + |6™' m — 6 t |. 
Therefore, without loss of generality we may assume that b is continuous and .S-integrable. Let us denote 

by 

n r t > n = b t ^ n £t(-(bV' n )-S), 
x 

for r E [0, T],n 6 A, where ipl' n = /( r _i ;T . + A\(t)(l — n\t — r\). It is evident that 7r™ belongs to U x for all 
r,n> 1. Indeed, 

t t 

x + [ iryS u = x + x [ £ u {-bV n ■ S)-b u ^ r ' n (u)dS u 
J J x x 



= x£ t (-W' n -S) >0. 

x 
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Denote by 7 t the expression ess inf 7r t — 6 t . By definition j t < Kt — bt\, [J, -a.e. for all ir G H x . Therefore 

-rrGlIa; 

7t < l 7r t'"' — I on the set B with (P c ) = for all rational r G [0,T] and integer n. Let 

7t = 7 t , if (w,i) G P and 74 = 0, if (w,f) G P c . 

Then 7 t < |7iy™ — t> t | for all t, u>, r, n. It is easy to see that ir r t ,n is continuous function of variables s, t for 
each n, since ip*' n = J* *(l (s _j_ iS) (u) - l (s s+ j_ } (u))du and 

t t t / V \ 

J Vu n KdS u = r t ' n J KdS u - j [j b u dS u (l (a _i, a) («) - d« 
\o / 

t sAt ( S +^)A* 

= i/y" j b u dS u - j b u dS u + J b u dS u 



(s-^)vo svo 



are continuous. Hence 7r['™ — > 7r*' n , as r — > s uniformly in t G [0,T]. Passing to the limit as r — > s we 



have 



7t < kt'" - &t|, for all t,s P- a.s. 



Since P — a.s. 

tt|'™ = & s f s (i(6^ s '™) • 5) -» 6 S , as n -> 00, 
we can conclude that 7 S = for all s P— a.s.. This implies that 7 S = 0, fi K —&.e.. 



Appendix B 

Now we introduce some notions which enable us to present an application of Theorem 1 to the Markov 
case. 

Consider the system of stochastic differential equations (5.1), (5.2) and assume that conditions SI) 
and S2) are satisfied. Under these conditions there exists a unique weak solution of (5.1), (5.2), which 
is a Markov process and its transition probability function admits a density p(s, (xo,yo),t, (x,y)) with 
respect to the Lebesgue measure. We shall use the notation p(t, x, y) — p(0, (xo, yo),t, (x, y)) for the fixed 
initial condition So = xq , Po = J/o • 

Introduce the measure n on the space ([0,T] x R d + x R n ~ d , B([0, T] x R d + x R n - d )) defined by 

fi(dt, dx, dy) = p(t, x, y)dtdxdy. 

Let C 1 ' 2 be the class of functions / continuously differentiable at t and twice differentiable at x, y on 
[0, T] x R+ x R n ~ d . For functions / G C 1 ' 2 the L operator is defined as 

Lf =ft + tr(^diag(x)a l a 1 diag(x)f xx ) +tr(Sa l diag(x)f xy ) 
+ tr( l -(55' + ^^')f yy ) 

where f t , f xx , f xy and f yy are partial derivatives of the function /, for which we use the matrix notations. 

Definition B. We shall say that a function / = (f(t,x,y),t > 0, x G P+,y G R n ~ d ) belongs to 
the class if there exists a sequence of functions {f n ,n > 1) from C 1 ' 2 and measurable ^-integrable 
functions f Xi (i < d), f Vj (d < j < n) and (Lf) such that 

Psup \f n (s, S S ,R S ) - f(u,S u ,R u )\ -> 0, asn —> 00, 

s<T 

(f Xi (s,x,y) - f Xt (s,x,y)) 2 x 2 n(ds,dx,dy) 0, i < d, 

[0,T]xR d _xR"' d 

(fy 3 (s, x, y) - fyj (s, x, y)) 2 n(ds, dx, dy) -»• 0, d<j<n, 

[0,T}xR d _xR n - d 
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J j \Lf n (s,x,y) - (Lf)(s,x,y)\n(ds,dx,dy) -> 0, 

[0,T] x_R| xR"- d 

as n — > oo. 

Now we formulate the statement proved in Chitashvili and Mania (1996) in the case convenient for 
our purposes. 

Proposition B. Let conditions Sl)-S2) be satisfied and let f(t,S t ,Rt) be a bounded process. Then 
the process (f(t, S t ,Rt),t € [0, T]) is an ltd process of the form 

t t 

f(t,St,Rt) = f(p,So,Ro) + J g{s,uj)dW s + J a{s,u)ds, a.s. 



with 

t t 
E J g 2 (s,w)ds < oo, E j \a(s, uj)\ds < oo (B.l) 
o o 
if and only if / belongs to V^. Moreover the process f(t, S t ,Rt) admits the decomposition 

d * 

f(t,S t ,R t ) = f(0,S ,R ) + Y^ / f Xi (s,S s ,R s )dSi+ 

1=1 o 

j f yj {s,S s ,R s )dR{+ f(Lf)(s,S s ,R s )ds. (B.2) 

Remark. For continuous functions f e the condition 

sup \f n (t, x, y) f(t, x,y)\ > 0, as n ► oo (B.3) 

for every compact D e [0, T] x i? 1 ^ x R n ^ d 1 can be used instead of the first relation of Definition B. 
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